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Abstract 


This  thesis  investigates  the  application  of  two- 
dimensional  moment  invariants  to  image  pattern  recognition. 
The  general  problem  studied  is  how  to  identify  an  aircraft 
target  and  its  orientation  in  real  time.  The  method  of 
moment  invariants  provides  a  clever  feature  extraction 
technique  to  reduce  the  information  in  an  image  to  a 
finite  number  of  quantities  which  are  translation,  .size, 
and  rotation  independent.  Most  of  the  previous  work  on 
image  pattern  recognition  has  been  based  on  the  results 
obtained  by  M.  K.  Hu,  who  relied  on  the  theory  of  algebraic 
invariants.  In  this  thesis,  a  set  of  moment  invariants  is 
derived  from  the  group-theoretical  properties  of  the  two- 
dimensional  rotation  group  '■applied  to  the  moments  of  an 
image  intensity  function.  It  is  shown  that  Hu’s  invariants 
can  be  obtained  from  .this  set  and  is,  in  fact,  an  equivalent 
complete  description  of  the  image.  The  application  of  group 
methods  to  moments  presents  a  general  procedure  for  cal¬ 
culating  moment  invariants  under  any  linear  transformation. 
The  image  signal  effect  of  thresholding  the  background 
clutter  is  also  discussed. 
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I. 


Introduction 


Artificial  intelligence  has  long  been  an  area  of  much 
study,  and  the  ability  to  recognize  visual  images  represents 
a  major  effort.  However,  research  on  pattern  recognition  has 
been  hampered  by  the  lack  of  a  general  theory  of  feature 
extraction.  That  is,  what  properties  make  one  image  unique 
from  another,  and  how  are  those  properties  ranked  according 
to  their  importance  in  the  identification  of  the  image? 
Generally,  studies  in  pattern  recognition  have  relied  on 
heuristic  criteria  for  feature  selection.  The  method  of 
moment  invariants  developed  by  M.K.  Hu  (Ref  1:  179-187) 
provides  a  clever  feature  vector  with  which  an  image  may  be 
described.  This  thesis  further  investigates  the  application 
of  two-dimensional  moment  invariants  to  image  signal 
processing  to  identify  a  three-dimensional  object  and  its 
orientation . 

The  general  problem  formulation  is  how  to  efficiently 
utilize  in  real  time  visual  information  signals  from  an 
optical  system  for  the  identification  and  analysis  of  the 
visual  pattern.  Examples  of  the  optical  systems  in  question 
may  include  television  monitors,  infrared  sensors,  or  even 
laser  radar  returns.  Usually,  the  information  content  of 
even  a  single  image  is  orders  of  magnitude  greater  than  what 
may  be  actually  needed  to  recognize  the  object.  The 
method  of  moments  provides  a  systematic  procedure  for 
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extracting  numerical  features  from  an  image.  By  compiling 
a  "library"  of  moment  invariants  for  an  object  set,  it  may 
be  possible  to  divide  the  feature  vector  space  into 
separable  regions  by  some  type  of  classifier. 
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II. 


Previous  Development 


The  original  concept  of  using  moment  invariants  for  the 
purpose  of  visual  pattern  recognition  was  first  published  by 
M.K.  Hu  in  1962  (Ref  1:179  -  187) .  A  framework  was  estab¬ 
lished  for  deriving  a  complete  set  of  two-dimensional  moment 
invariant  functions  under  translation,  rotation,  and 
similitude.  His  approach  was  related  to  the  study  of 
algebraic  invariants  based  on  the  work  of  the  nineteenth 
century  mathematicians  Boole,  Cayley,  and  Sylvester.  In¬ 
terest  declined  in  the  study  of  invariant  forms  following  the 
initial  nineteenth  century  work,  but  the  application  to 
visual  pattern  recognition  has  generated  much  recent  interest. 

S.B.  Dudani  extended  the  moment  invariant  concept  to 
the  identification  of  three-dimensional  objects  in  his 
masters  thesis  (Ref  2)  and  in  his  doctoral  dissertation 
(Ref  3)  on  an  experimental  study  of  aircraft  identification 
using  moment  methods .  Dudani 1 s  work  formed  the  starting 
point  of  the  U.S.  Navy's  algorithms  in  their  Automatic 
Aimpoint  Selection  and  Maintenance  (AUASAM)  program  and  also 
the  U.S.  Air  Force's  Image  Processing  Automatic  Acquisition 
Control  System  (IPAAACS)  conceptual  design  study  (Ref  4:45). 
Dudani  oriented  his  study  toward  video  imagery  and  only  used 
the  information  contained  in  the  second  and  third  order 
moments  calculated  over  the  image  silhouette  and  boundary. 
After  constructing  classifiers  (Bayes,  K-nearest  neighbor, 
sequential)  over  an  object  set,  it  was  shown  that  the 
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classifier's  performance  was  superior  to  human  test  subjects. 


More  recently,  M.R.  Teague  established  a  framework  for 
describing  an  image  in  terms  of  a  finite  number  of  moments 
(Ref  4) .  The  inverse  problem  of  how  to  reconstruct  an  image 
given  a  finite  number  of  moments  was  addressed  and  served  to 
illustrate  the  information  content  of  successively  higher 
order  moments.  For  example,  the  second  order  moment 
approximation  to  an  image  intensity  function  is  equivalent 
to  an  ellipse  of  constant  intensity  magnitude.  A  set  of 
moments  and  moment  invariants  was  also  derived  based  on  the 
orthogonal  Zernike  polynomials.  In  another  paper,  Teague 
described  an  optical  processing  scheme  to  obtain  image 
irradiance  moments  of  arbitrary  order  (Ref  5) .  The  optical 
wave  limitations  on  accuracy  was  also  discussed. 

Recently,  Texas  Instruments  used  moment  invariants  as 
part  of  the  feature  vector  for  a  guidance  algorithm  in  a 
demonstration  at  Eglin  A.F.B.  The  algorithm  was  slated  for 
use  in  a  mini-computer  for  real-time  performance  (Ref  6) . 
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Ill .  Definition  and  Theory  of  Moment  Invariants 


Historically,  M.K.  Hu  first  conceived  the  idea  of  using 
moment  invariants  for  pattern  recognition  of  visual  imagery 
(Ref  1:  179-187).  His  approach  will  be  followed  in  this 
section.  The  moment  invariant  functions  are  related  to  the 
algebraic  invariants,  and  a  complete  set  of  invariants  is 
derived  under  translation,  rotation,  and  similitude. 

Raw  and  Central  Moments 

The  concept  of  moments  is  not  new,  being  used  extensive¬ 
ly  in  classical  mechanics  and  statistical  studies.  The 
two-dimensional  (p+g)th  order  moment  of  a  density  distribu¬ 
tion  function  p(x,y)  in  Cartesian  coordinates  is  defined  as 


M 


pq 


*/— co  —  □ 


Y  p(x,y)  dxdy  p,q  =  0,1,2. 


(1) 


For  image  processing  purposes,  p(x,y)  is  the  image  intensity 
distribution  across  the  optical  plane.  Under  practical 
conditions  all  orders  of  moments  exist,  and  the  sequence  of 
moments  JM  is  unique  to  p(x, y) ,  and  conversely.  These 
conditions  are  usually  met,  or  at  least  approximated,  over  an 
optical  system  image  plane. 
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The  central  moment  u  is  defined  as 

-  rpq 


.co  ,  co 


pq 


~  [  f  (x  -  x)p(y  -  y)qp(x,y)  d(x  -  x)d(y  -  y) 

-CO  ''—CO 
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where 
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00 


By  a  simple  change  of  variables,  it  is  obvious  that  under 
the  transformation  of  translation. 


x'  =  x  +  « 

y 1  =  y  +  P 


(4) 


where  a  and  are  constants,  the  central  moments  are  in¬ 
variant  . 

From  the  definition  of  central  moments,  Eq  (2) ,  it  is 
easy  to  express  the  central  moments  in  terms  of  the  raw 
moments.  For  example. 
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A  general  formula  for  calculating  the  central  moments  in 
terms  of  the  raw  moments  is 


=  ^  £;  <-i>p+q-J  (p-j)(q-i+j) ;  p-J 

i=0  j=S 

.  y  q-i+JM.  .  .  (6) 

J.i-J 

s  =  \  ( (p+i)  -  |p-i|J  T  =  J  |  (i-q)  +  |i-q|| 


where  x  and  y  are  defined  in  Eq  (3)  and  the  notation 
denotes  the  usual  binomial  coefficient.  A  listing  of 
the  central  moments  up  to  the  fifth  order  is  contained  in 
Appendix  A.  Perhaps  a  more  convenient  form  is  the  recursive 
formula 

J^fq-i 

*W  MPq  -  E 

i=0 


which  calculates  u  in  terms  of  the  raw  moment  M  and 

pq  pq 

the  lower  order  central  moments.  Appendix  B  lists  the 
recursive  central  moments  for  several  orders.  All  moments 
referred  to  hereafter  will  be  the  central  moments  unless 
otherwise  stated. 
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The  Algebra  of  Invariants 

The  homogeneous  polynomial  in  two  variables, 


f  =  a 


a  up  +  (l)  a  ,  up  1  v  +  •  •  •  +  (  p,)a, 
po  P-1/1  \P-1/  1/P-l 


(8) 


+  a  v 
op 


is  a  binary  auantic  of  order  p.  Using  the  notation  common 
in  the  study  of  algebraic  invariance,  Eq  (8)  can  be  written 


f  =  (a 


po;  p-1,  1 


l,p-l; 


aop)  (u'  v) 


(9) 


If  the  general  linear  transformation. 


u 

a 

y 

u  1 

V 

0 

6 

V’ 

where  the  determinant  A  is  not  zero,  is  applied  to  f, 
function  f1  is  obtained 


(10) 


a  new 


f1  =  (a 


po 


ap-l,  1 


a1 


1,  p-1; 


a1  )  (u1  ,  V  )p 

op 


(11) 


with  the  same  form  as  f,  but  with  new  coefficients.  Then, 
if  a  homogeneous  polynomial  1(a)  of  the  coefficients  of  f 
exists,  such  that 


I  (a 


po 


aop} 


AW  I  (a 


po 


op' 


(12) 
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then  1(a)  is  an  algebraic  invariant  of  weight  w.  For  w^O, 
the  invariant  is  called  a  relative  invariant  and  depends  on 
the  transformation.  If  w=0(  then  1(a)  is  an  absolute  in¬ 
variant  .  By  eliminating  A  between  two  relative  invariants, 
a  nonintegral  absolute  invariant  can  always  be  obtained. 

Moment  Invariants 

From  the  Fundamental  Theorem  of  Moment  Invariants 
derived  by  Ku  (Ref  1:181),  the  algebraic  invariants  are 
related  to  the  moments  of  the  same  order.  That  is,  if  an 
algebraic  form  of  order  p  has  an  invariant  of  the  form  of 
Eq  (12) ,  then  the  moments  of  order  p  have  the  same  invariant 


I(H' 


po 


u '  ) 
M°P 


=  I J  |  Aw  I(|i 


po 


^op^ 


(13) 


but  with  the  additional  factor  |j|,  where  J  is  the  Jacobian 
of  the  transformation. 

By  direct  substitution  of  the  similitude  (change  of  size) 
transformation 


- 

- 

- 

X' 

a 

0 

X 

Y\ 

0 

a 

y. 

into  the  definition  of  moments,  every  moment  is  seen  to  be  an 
invariant. 


pq 


p+q+2 
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(15) 
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From  the  zeroth  order  relation, 


2 


a 


(16) 


and  substituting  into  Eq  (15)  for  a  yields  the  absolute 
invariants 


J2£L 


pq 


(p+q+2)/2  = 


J2SL 


(p+q+2)/2 


00 


00 


(17) 


Under  the  following  rotation  transformation. 


x' 

y 


cosO  sine 

X 

-sine  cose 

Y 

(18) 


where  6  is  the  angle  of  rotation,  the  absolute  value  of  the 
Jacobian  is  seen  to  be  |j|  =  1.  Therefore,  according  to  the 
Fundamental  Theorem  of  Moment  Invariants,  the  moment  in¬ 
variants  are  the  same  as  the  algebraic  invariants.  If  the 
moments  are  used  as  the  coefficients  of  an  algebraic  quantic. 


f  = 


>V <u'  V)P  - 


(19) 
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then  there  is  a  clever  technique  to  derive  the  necessary 
invariants.  From  the  transformations. 


By  eliminating  the  factor  ,  a  complete  system  of 
absolute  invariants  is  obtained.  For  the  second  and  third 
order  moments,  the  invariants  are 


’ll 


I02I 20 


I30I03 


3  3 

IT  IT  +ITJ 

?1a12  x30x12  x03x21 


2  2 
T  T  +  I  T 

x20x12  x02x21 


1(1  T  3  I  T  3  ) 

4-  kx30x12  03  x2l' 


(24) 

(25) 

(26) 

(27) 


The  last  relation  changes  sign  under  improper  rotation  and  is 
called  a  skew  invariant.  Eq  (27)  is  useful  for  .distinguish¬ 
ing  "mirror  images".  Eqs  (24)  -  (27)  can  be  expressed  in 
terms  of  the  central  moments , 


P20  +U02 

(y20-P02)2  +  ‘:yll 

(U30  -3P12)  +  (3y21  -y03* 

(y30  +yl2)2  +  (P21  +y03) 


(28) 

(29) 

(30) 

(31) 
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IV.  A  New  Set  of  Moment  Invariants 

Based  on  the  Methods  of  Group  Theory 

A  new  set  of  moment  invariants  is  derived  from  the 
mathematical  methods  of  the  theory  of  groups.  Group  theory 
has  been  applied  to  problems  in  physics  where  the  concepts 
of  symmetry  and  invariance  are  important.  Such  physical 
notions  as  parity,  spinor,  and  angular  momentum  are  aspects 
of  group  properties.  Most  of  the  previous  work  on  moment 
invariants  has  been  based  on  the  results  obtained  by  Hu 
(Ref  1:  179-187),  which  relies  on  the  theory  of  algebraic 
invariants.  The  application  of  group  methods  to  the  same 
problem  represents  a  new  and  different  viewpoint. 

This  chapter  develops  the  basic  mathematical  concepts 
and  definitions  leading  up  to  the  derivation  of  a  set  of 
invariants.  The  approach  taken  is  drawn  from  Hamermesh 
(Ref  7:  6-30,  77-113).  The  concepts  are  then  applied  to  the 
particular  case  of  invariance  with  respect  to  rotation  in  a 
plane . 

Basic  Concepts  and  Definitions 

An  abstract  group  G  is  defined  as  a  set  of  elements  for 
which  a  law  of  "multiplication"  or  combination  is  given  such 
that  the  "product"  ab  of  any  two  elements,  a  and  b  in  G,  is 
defined  and  also  satisfies: 

1.  If  a  and  b  are  elements  of  G,  ab  is  also. 
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2.  Multiplication  is  associative,  a  (be)  =  (ab)c. 

3.  A  set  identity  element  e  exists  such  that  ae  =  ea 
=  a  for  any  element  a  of  the  set. 

4.  For  any  element  a  of  G,  an  inverse  element  b  =  a-"*" 
is  also  contained  in  the  set  such  that  ab  =  ba  =  e . 

In  this  context,  "multiplication"  does  not  mean  an  algebraic 
product,  but  refers  to  a  rule  under  which  two  set  elements 
are  combined.  If  in  addition  to  the  above  conditions,  all 
elements  commute  among  themselves,  the  set  is  abelian .  From 
the  concept  of  abstract  groups,  a  transformation  group  may  be 
visualized  by  associating  transformations  of  a  set  of  points 
as  the  group  elements.  This  gives  a  pictorial  viewpoint  of 
the  group  notion. 

The  number  of  elements  in  a  group  is  called  the  order  of 
the  group.  The  notation  an  implies  the  product  of  n  elements 
each  equal  to  a.  Negative  powers  of  element  a  are  also 

j  j  -m  ,  —  1  * m  ,  m »  —  1 

defined,  a  =  (a  )  =  (a  ) 

Two  groups,  G  and  G‘,  are  isomorphic  if  their  elements 
can  be  put  into  one-to-one  correspondence  which  is  preserved 
under  combination.  If  two  groups  are  isomorphic,  they  have 
the  same  structure.  Their  symbols  may  differ,  but  their 
respective  abstract  groups  are  the  same.  Similarly,  a 
homomorphic  mapping  of  G  on  G'  preserves  products,  but  now 
several  elements  of  G  may  have  the  same  image  in  G'. 

Group  Representations 

In  a  vector  space  L,  a  set  of  operators  forms  a  group 
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if  it  satisfies  the  definition  given  above.  The  product 
of  two  operators  A  and  B  on  the  vector  X  means  the 
single  operator  CX  =  A(BX)  for  all  X  in  L.  The  identity 
operator  leaves  the  operand  unchanged,  and  all  operators 
have  an  inverse.  If  the  vector  space  L  is  mapped  onto  a 
second  space  L',  via  an  operator  S,  an  isomorphic  group  of 
operators  is  obtained  in  L1  which  are  transforms  of  the 
vectors  in  L,  A1  =  SAS-1. 

If  a  group  G  is  mapped  homomorphically  onto  a  group 
of  operators  D(G)  in  the  vector  space  L,  the  operator  group 
D(G)  is  a  representation  G  in  the  representation  space  L. 
If  L  has  dimension  n,  the  representation  has  degree  n  or  is 
an  n-dimensional  representation.  If  the  homomorphism 
reduces  to  an  isomorphic  mapping,  the  representation  D(G) 
is  faithful ,  and  the  order  of  D(G)  is  equal  to  the  order 
g  of  G.  The  operator  corresponding  to  an  element  R  in 
group  G  will  be  denoted  by  D(R) .  If  R  and  S  are  elements 
of  G,  then 


D(RS)  = 

D  (R)  D  (S) 

(35) 

D(R_1)= 

|  D(R)|  _1 

(36) 

D  (E)  = 

1. 

(37) 

where  E  represents  the  identity  transformation. 


A  linear  representation  is  a  group  representation  in 
terms  of  linear  operators.  All  representations  hereafter 
are  assumed  to  be  linear,  unless  specifically  noted  other¬ 
wise  . 

Given  a  basis  in  L,  the  linear  operators  of  the 
representation  can  be  represented  by  their  matrix  represent¬ 
atives.  Group  G  is  then  mapped  homomorphically  onto  a 
group  of  matrices  D(G) ,  giving  a  matrix  representation  of 
the  group.  The  matrices  are  nonsingular  and 


The  transformed  matrix  also  gives  a  representation  of  the 
group  and  is  equivalent  to  D(R) .  Equivalent  representations 
have  the  same  structure,  even  though  the  matrices  appear 
dissimilar. 

An  intrinsic  property  of  a  representation  D(R) ,  in¬ 
dependent  of  basis,  is  the  trace  X(R) ,  or  the  sum  of  the 


- 
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diagonal  elements  of  the  matrix  representation. 


X(R) 


T'D. . (R) 
l  11 


(40) 


The  trace  is  called  the  character  of  R  in  the  representation 
D.  Equivalent  representations  have  the  same  set  of 
characters . 

Given  a  transformation  T  belonging  to  a  transformation 
group  G  (or  to  the  group  associated  with  the  matrix  repres¬ 
entation  D (G) ) ,  new  representations  can  be  constructed. 
Transformation  T  acts  on  X  to  produce  X'  :  X  =  TX.  A 
linear  operator  associated  with  T  acts  on  some  function 
4,(X)  such  that 


*’  (X1)  =  0T*(x')  =  *(X)  ,  (41) 

if  X  =  TX.  In  other  words,  the  transformed  function 
takes  the  same  value  at  the  image  point  X  as  the  original 
function  <f?  at  the  object  point  X.  Another  way  of  putting 
it  is  that  the  effect  of  the  operator  ot  is  as  the  point  P 
is  transformed  to  image  point  P’,  it  carries  with  it  the 
value  of  ♦  at  P. 

Therefore 


ot*(tx) 

=  *(X) 

(42) 

or 

0T*(X) 

=  *(T  Xx)  . 

(43) 

__  .> 
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The  general  procedure  for  constructing  representations 


should  now  be  clear.  Apply  all  the  operators  0D  correspond- 
ing  to  the  transformation  group  to  each  of  any  set  of 
linearly  independent  functions.  A  set  of  functions  is 
obtained  which  can  be  expressed  linearly  in  terms  of  n  of 
them,  4^,  ^ •  Applying  any  operator  0R  to  these 

functions  results  in  a  linear  combination  of  the  same  n 
functions , 

n 

OrYj  =  Dij(R)  J  =  1 . n-  (44) 

i=l 


The  correspondent  of  the  element  R  in  the  representation  is 
then  the  matrix  D(R) . 

Reducible  and  Irreducible  Representations 

Given  a  representation  D,  it  is  possible  to  describe  it 
in  terms  of  "simpler"  representations.  Roughly , "simpler" 
means  that  the  representations  have  the  lowest  dimensions 
possible.  In  general,  if  a  basis  exists  in  which  all 
matrices  D(R)  of  an  n-dimensional  representation  can  be 
brought  to  the  form 


D(R)  = 

D(1) (R)  *  A (R) 

0  ’p  ^ (R)  . 

(45) 


where  D ^  (R)  has  m  x  m  dimensions,  (R) 


is  (n-in)  x  (n-m)  , 
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and  A(R)  is  m  x  (n-m) ,  then  the  representation  is  reducible . 
An  intrinsic  indicator  of  reducibility  is  that  there  exist 
some  subspace  of  dimension  less  than  the  representation 
which  is  invariant  under  the  transformations  of  the  group. 

If  it  is  possible  to  find  a  basis  such  that  the  representa¬ 
tion  matrices  have  the  form  of  Eq  (45)  with  A(R)  being  the 
zero  matrix,  the  representation  is  fully  reducible.  A 
representation  for  which  there  is  no  invariant  proper  sub¬ 
space  is  irreducible . 

Among  the  irreducible  representations  there  may  be 
several  which  are  equivalent.  These,  of  course,  must  have 
the  same  dimensionality.  Equivalent  irreducible  represent¬ 
ations  are  not  distinct,  and  the  same  symbol  can  be  used  for 
them.  Also,  a  representation  of  a  group  may  contain  a 
particular  irreducible  representation  several  times. 

Invariance  of  Functions 

Recalling  Eq  (43),  0R4' (X)  =  Y  (R_ ^X)  ,  it  is  clear  that 

O  operating  on  4*  replaces  X  by  R  ^X.  It  is  possible  that 

0  4*  is  identical  with  V  , 

K 

Or4'  (X)  =  ¥(X)  (46) 

so  that 

'F(X)  =  4,(r“1x) 

y  (RX)  =  't'(x)  •  (47) 


.V 
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In  this  case,  the  function  ^  takes  on  the  same  value  at  the 
image  point  as  the  object  point,  and  is  invariant  under  the 
operator  0D,  or  more  briefly,  under  the  transformation  R. 

To  test  for  invariance  of  a  function,  the  arguments  are 
replaced  by  their  images  to  see  if  the  same  expression  is 
obtained. 

In  the  theory  of  representations,  a  complex  number 
(X,  Y) ,  called  the  scalar  product,  is  associated  with  each 
pair  of  vectors  X  and  Y  in  vector  space  L  such  that: 


1. 

(X, 

Y)  =  (Y,  X)* 

(48) 

2. 

(X, 

aY)  =  a(X,  Y) 

(49) 

3. 

(*1 

+  X2,  Y)  =  (Xx,  Y)  +  (X2,  Y) 

(50) 

4. 

(X, 

X)  >  0 

(51) 

and  (X,  X)  =  0  only  if  X  is  the  zero  vector.  A  space  in  which 
a  scalar  product  is  defined  is  called  a  unitary  space.  In 
defining  the  scalar  product,  a  basis  was  not  mentioned,  which 
means  that  (X,  Y)  is  an  intrinsic  property  of  the  vectors 
X  and  Y,  and  is  independent  of  basis. 

Any  function  satisfying  Eqs  (48)  -  (51)  can  be  used  to 
define  a  scalar  product  in  the  space  L.  One  definition  of 
(X,  Y)  is  to  write  it  as  a  function  of  the  vector  coordinates 
and  y^  in  a  particular  basis.  If  the  basis  vectors  are 
ui,  a  metric  matrix  M  is  defined  by 

mij  =  (iV  V  '  (52) 
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From  Eq  (48) ,  it  is  clear  that 


m .  .  =  . 

iJ  Ji 


M  =  M  + 


(M^) . .  =  m* . 
-  1J  Ji 


Where  is  the  conjugate  of  matrix  M  transposed  and  is  the 

adjoint  of  M.  A  matrix  which  is  identical  to  its  adjoint  is 
called  self-adjoint  or  Hermitian .  Therefore,  from  the 
above,  M  must  be  Hermitian.  If  vectors  X  and  Y  are  expanded 
in  the  basis  u. , 

l 


X  =  x.u.  +  •  •  •  +  x  u  =  x.  u. 
11  n  n  i  i 


Y  =  y.u.  +  •  •  •  +  y  u  =  y.u. 
•'ll  •'n  n  —  •*  j  j 


then  it  is  clear  that 


(X,  Y)  =  (xi5.  ,  y.u., 


(X,  Y)  =  X+M  Y 


where  X  and  Y  are  column  matrices  and  X  is  the  adjoint  of  X. 
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Two  vectors  in  a  unitary  space  are  orthogonal  if  their 

scalar  product  is  zero,  (X,  Y)  =  0.  Given  a  basis  in  the 

unitary  space  L,  a  new  set  of  basis  vectors  vL  that  are 

mutually  orthogonal  can  always  be  constructed  and  forms  an 

orthonormal  basis  if  (u.  ,  u.)  =  6.  .. 

-  i  j'  ij 

In  a  unitary  space  L,  the  distance  | X  —  Y |  between  two 
vectors  is  defined  from 

lx  -  Y 1 2  =  (X  -  Y,  X  -  Y)  .  (59) 

A  sequence  of  vectors  Xn  (n  =  1,  ...,“)  in  L  is  said  to 

1  i  tn 

converge  toX  in  L  if  lx  -  xl  =  0.  The  seauence  of 

n  — co  n 

vectors  Xn  is  said  to  be  a  fundamental  sequence,  if 

n— <D  ”  *nl  =  If  ©very  fundamental  sequence  converges 

to  a  vector  in  the  vector  space  L,  the  space  is  complete . 

A  complete  unitary  space  is  called  a  Hilbert  space.  The 
unitary  spaces  of  finite  dimension  are  complete.  Infinite 
dimensional  representations  will  be  restricted  to  represent¬ 
ations  by  linear  operators  in  a  Hilbert  space  under  the 
condition  that  the  operators  are  continuous. 

To  tie  the  preceding  paragraphs  together  with  in¬ 
variants,  assume  that  an  irreducible  representation  D(R)  is 
unitary.  Then  the  scalar  product  of  vectors  in  the  Hilbert 
space  of  the  representation  is  invariant. 


The  inverse  transpose  of  each  of  the  matrices  of  an 


irreducible  representation  is  also  a  representation  of 
the  group  and  is  called  the  adjoint  representation  5  (R) , 

D (R)  =  D  _1  (R)  .  (60) 

Likewise,  the  complex  conjugate  of  D(R)  is  the  complex 

★ 

conjugate  representation  D  (R) .  If  the  adjoint  represent¬ 
ation  and  the  complex  conjugate  representation  are 
equivalent 


D  1  (R)  ~  D*(R)  , 

there  exists  a  matrix  F  such  that 

★  1  1  ~ 

D  (R)  =  F  D  (R)  F 

D+(R)  =  FD_1(R)F_1 


(61) 


(62) 


or 


D+(R)FD(R)  =  F.  (63) 

Then  (Y,F  x)  is  invariant  under  all  transformations  of  the 
group  G.  In  fact,  for  an  irreducible  representation,  there 
can  be  no  more  than  one  invariant  of  this  form. 
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Expansion  of  Function  in  Terms  of  an  Irreducible  Representa¬ 
tion  Basis 

As  noted  previously,  a  representation  of  group  G  can  be 
constructed  by  applying  the  transformations  of  G  to  any 
function  V.  Then  *  will  be  a  base  function  or  a  linear 
combination  of  the  basis.  This  can  be  extended  further  by 
decomposing  the  representation  into  its  irreducible 
constituents.  In  other  words,  any  function  4  can  be 
expressed  as  a  sum  of  the  base  functions  in  the  irreducible 
representations , 

% 

^  =  E  S  .  (64) 

v  1=1 

The  base  functions  for  the  vth  irreducible  unitary 
representation  satisfies 

ViV)  =  Z  'i'jV)cji)  (R)  •  (65) 

j 

The  desired  aimpoint  is  to  find  the  given  the 

function  V .  In  other  words,  how  can  the  given  function 

be  resolved  into  a  sum  of  functions,  each  belonging  to  a 

particular  row  of  an  irreducible  representation? 

(u )  * 

If  Eq  (65)  is  multiplied  by  D^m  (R)  and  summed  over 
the  entire  group 
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Dlm,*(R)  DjiJ  {R) 


2 


(R)  0R 


y  ,(V) 


-I',z 


=  a  4'1(v)  6  .  6 
n  1  mi  yv 


(66) 


due  to  the  orthogonality  relations  of  Appendix  D.  For  the 
case  m  =  k  =  i  and  y  =  v 


n 

y(v)  =  _2 

i  g 


2 


o 


R 


(67) 


That  this  is  a  necessary  and  sufficient  condition  on  the 

such  that  Eq  (65)  is  satisfied  is  proven  in  Appendix  E. 
A  projection  operator  is  defined  from  Eq  (66)  as 


2 


R 


such  that 


p(M)  y  (V)  =  yftO  6  6.  .. 

i  j  i  yv  ij 


(68) 


(69) 


Appendix  E  shows  that  if  the  ^  is  applied  to  Eq  (64) , 
the  result 


y  (M) 


*  (R) 

11 


R 


(70) 
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is  obtained  or. 


Y  -U)  =  -  (71) 

which  is  the  desired  end.  Briefly,  to  find  the  projection 
of  a  function  onto  a  basis  function  of  an  irreducible 
representation,  multiply  by  the  basis  function  and  sum  over 
the  entire  group.  Another  way  of  viewing  it  is  that  the 
projection  operator  finds  the  component  of  V  in  the 
"direction"  of  the  basis  function. 

Application  of  Group  Theory  to  Moment  Invariants 

The  basic  tools  are  now  available  to  derive  a  set  of 
moment  invariants  under  the  rotation  transformation.  The 
rotation  transformation  of  Eq  (18) 

x'  =  COS0  SIN  0  x 

(18) 

y 1  -sin©  cos©  J  y 

forms  an  infinite  continuous,  abelian  transformation  group 

over  the  region  0  e  {o,2tt|.  For  simplicity  of  notation, 

COSm0  5  C  and  SINmO  =  S  The  approach  taken  is  simple: 
m  m. 

(1)  Form  a  reducible  matrix  representation  of  the  rotation 
group,  (2)  use  the  projection  operator  to  form  vectors 
in  terms  of  the  irreducible  basis  functions,  and  (3)  form 
invariants  of  the  scalar  product  form.  As  before,  all 
reference  to  moments  is  taken  to  mean  central  moments. 


Using  the  notation  of  the  expected  valve  operator. 


the  pqth  moment  can  be  written 


y  =  Elxpyq|. 

pq  1  1 


(72) 


Under  the  rotation  operation,  the  new  moments  become 


pq 


=  E  |  (xC+yS) P (-xS+yC) q|  . 


(73) 


The  zeroth  order  moment  remains  the  same. 


M00  p00. 


(74) 


and  the  first  order  moments  in  terms  of  the  unrotated 
moments  become 


I 

r 

y01 

1 

.  V110  . 

L 

C 

S 


y01 

J 

.U10. 

(75) 


Thus,  the  reducible  representation  is  obtained.  Appendix  F 
lists  the  rotated  moments  up  to  the  sixth  order.  In  order 
to  obtain  the  same  likeness  as  in  Appendix  F,  the  trig¬ 
onometric  identities  of  Appendix  G  will  be  useful. 

The  projection  operator,  previously  defined  in  Eq  (68) 
can  now  be  used  to  expand  the  transformed  moments  above  in 

terms  of  the  basis  of  the  associated  irreducible  represent- 
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ation.  By  applying  Eq  (70)  to  the  reducible  representa¬ 
tions  above,  a  vector  in  a  Hilbert  space  is  obtained  whose 
components  are 


X 


(m) 

pq 


Hm  f  2v  .  ' 

2  tt  J  0  m  ^pq 


d0 


Y(m) 

pq 


m  Hpq 


de 


(76) 


where  an  integration  instead  of  a  summation  is  performed 
since  the  group  is  continuous.  The  irreducible  representa¬ 
tion  basis  is  composed  of  terms  of  the  form  C  and  S 

mm 

(m  =  0,  1,...)  where  m  can  be  thought  of  as  a  "frequency"  of 
rotation.  The  effect  of  the  projection  operator  is  to 
"peel  out"  that  component  of  the  pqth  representation  which 
has  frequency  m.  Thus  for  the  zeroth  order. 


X 


(0) 

00 


2y 


00 


Y 


(0) 

00 


0, 


and  for  the  first  order. 


(1) 

01 


10  . 
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(77) 


(78) 


....  -/ 


TT 


It  is  apparent  that  if  a  particular  representation  does  not 
contain  any  terms  with  a  specified  frequency  m,  then  the 
projection  operator  gives  the  zero  vector.  This  might  be 
expected,  since  the  term  does  not  have  any  components 
associated  with  the  specified  basis  vector.  The  projected 
moment  vectors  up  to  the  sixth  order  are  listed  in  Appendix 
H.  It  may  be  observed  that  a  distinct  vector  is  not  formed 
for  every  moment  within  an  order.  For  instance,  the  second 
order  vectors  from  Appendix  H 


X 


(0) 

02 


u  +u 
20  m02 


0 


(H-3) 


(2) 

02 


P20  ^02 ^ 


(2) 

02 


11 


(H-4 ) 


do  not  contain  vectors  corresponding  to  y^  and  y^o' 
However,  if  the  projection  operator  is  applied  to  these 
cases,  the  result 


y  (  2) 
X11 

2(p02  _U20) 

Y  (2) 
*11 

=  yll 

(79) 

y  (0) 
20 

M02  +U20 

Y(0) 

20 

=  0 

(80) 

y  (  2  ) 
20 

2(P02  _U20) 

Y  (2) 
20 

=  yll 

(81) 

is  obtained.  Comparing  Eqs  (79)  -  (81)  to  Eqs  (H-3)  -  (H-4) , 
it  is  seen  that  Eqs  (79)  and  (81)  are  the  negative  of  Eq 
(H-4)  , 
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and  Eq  (80)  is  the  same  as  Eq  (H-3) .  This  is  expected  since 
as  was  previously  noted,  among  the  irreducible  representa¬ 
tions  there  may  be  several  which  are  equivalent  and  are  not 
distinguishable . 

In  a  previous  section,  it  was  stated  that  the  only  form 
of  invariants  is  a  scalar  product  (Y,  F  X)  between  vectors 
within  an  irreducible  representation.  Since  the  rotation 
group  forms  a  unitary  representation,  the  matrix  F  must  be 
a  multiple  of  the  identity  matrix  by  Schur's  Lemma 
(Appendix  D) .  Therefore,  the  invariants  are  of  the  form 
(Y,  X) ,  a  direct  scalar  product.  For  the  vectors  derived 
above  for  the  rotation  group,  the  invariants  are  formed  only 
between  vectors  of  the  same  frequency,  or  more  fundamentally, 
between  vectors  from  the  same  representation.  It  is  evident 
that  invariants  can  be  formed  between  vectors  of  differing 
moment  orders,  but  with  the  same  frequency,  since  they  come 
from  equivalent  representations.  For  example,  an  invariant 
is  formed  within  the  second  order  moments, 

T(°)  =  y  (  0  )  y  (  0  )  .  „«»  Y  (  2  ) 

02 x02  u2  02  1 02  0 

^20  +U02^  ' 

by  forming  the  scalar  product  of  the  zero  frequency  vector 
corresponding  to  with  itself.  Another  invariant  is 
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formed  between  second  and  fourth  order  moments. 


I(0)  =  1  (U  +u  ) 

02u4  4  vp20  v02' 


(p40+  2m22 


+  y04} 


(83) 


Appendix  I  lists  the  invariants  formed  from  the  vectors 
of  Appendix  H. 

A  Complete  Set  of  Moment  Invariants 

A  "complete"  set  of  invariants  in  the  sense  to  be 
considered  means  that  the  moments  from  which  the  invariants 
were  formed  can  be  found,  and  in  turn,  the  image  itself  can 
be  reconstructed.  However,  this  is  not  completely  true. 

For  a  particular  image,  a  unique  and  complete  set  of 
two-dimensional  moments  of  all  orders  exists.  A  specific 
and  unique  relationship  exists  between  each  and  every 
moment.  To  obtain  independence  with  respect  to  translation, 
the  central  moments  were  introduced.  However,  invoking  the 
central  moments  discards  the  location  of  the  image  centroid. 
Independence  with  respect  to  rotation  is  obtained  at  the 
expense  of  the  angle  of  rotation  of  the  image.  But  a  unique 
relationship  still  exists  between  the  remaining  moments,  and 
in  fact,  the  invariants  are  a  description  of  that  relation¬ 
ship.  Thus,  to  obtain  invariance  with  respect  to  a  trans¬ 
formation,  some  information  about  the  image  is  discarded. 

From  Appendix  H,  the  vectors  from  the  second  and  third 
order  moments  are 
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0 


(H-3) 


X02  y20+y02 


02 


X02  2  (VJ20  y02)  Y02  P11 


(H-4) 


X03  4  (y21  +y03)  Y03 


-I(y30+yi2) 


(H-5) 


'03 


'4  (3y21“y03) 


3  1 


03 


4  (y30-3yi2) 


(H-6) 


X 


12 


4  ^  y30  +  ^ 


a  +  '  (H-7) 


12'  12  4  '^21  M03 


where  the  superscripts  indicate  the  frequency  of  rotation 
with  respect  to  the  image  rotation.  Since  there  is  not  a 
common  frequency  between  the  two  orders,  it  appears  that  no 
invariant  of  the  inner  product  form  can  be  constructed. 
However,  if  the  reducible  matrix  representation  associated 
with  the  second  order  moments  is  cubed  and  the  representa¬ 
tion  for  the  third  order  is  squared,  common  frequencies  are 
obtained  after  the  projection  operators  is  applied.  In 
particular,  for  the  second  order 


(y02} 


VJ 


3 

02 


(2  S6+6S4  +6S2)  M02Pi;l  <4  c6  +  2  C4  "4  C2  _52)y02y20 


-(-2s6  +6S2)  Wxl3  +(-3C6  -6C4  +3C2  +6) 
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+  (3S&  9s2 )u o2v‘  20u11 


+  (4  C6  2  C4  4  C2  +  2 ^  U20  y02 


(-3C6  +6C4  +5C2  -6) 


<2  S6  -6S4  +  ^  S2)l,20  “ll 


(1  c  .  1  c  +  A£  c  -  1)  u  3 

l4  6  2  C4  4  2  2  M20 


(84) 


and  after  applying  the  projection  operator  Lq  (76) 


X^=  —  y^-  —  y2y  ~3y  y  2  +  —  y  2y 

2  4  M02  4  m02  20  JM02  11  4  M20  02 


2  13 

+iy  y  _  —  y  J 
J  20  11  4  20 


Y  ^  y  2  y  +  ?  y  ^  +  3  y  y  y  _  —  y  2  y 

12  2  02  M11  ^11  JM02  20  11  2  20  11  .  (85) 


For  the  third  order 


1  7  l 

=  16 


f<C6  +6C4  +15C2  +10)  U0l  -3(S6  +  4S„  +5£2)W12Ui3 


-3(C6  +2C4  -C2  -2)W21603  +  f (-C6  -C4  +C2  +2) P J 
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+  (S6  -3S2)1,30U03  +9(S6  -3S2)l,2l‘,12 


-3(-C  +2C  +C  -2)  ^  ^ 

1  6  4  2  '  30  12 


+f(C6  -2C4  -C2  +2)  U21  +3(S6  -4S4  +5S2)U30U21 


+i(-C6  +6C4  -15C2  +10)„22 


(86) 


and 


X3  y03  -6y21y03  +9  y21  9y12  +6y30y12  y30 


Y3  ~  3y12y03  y30y03  +9y21y12  +3y30y21)  *87) 


X3  5  y0  3  +2y21y03  3  V21  +3y12  2y30U12  ~5y30 


Y3  2^  5  yl 2  y0 3  y30y03  9y2iyi2  +5y30y21)' 


Scalar  products  between  the  vectors  of  the  same  frequency 
can  now  be  formed 


(2) 

3I2  =  (  y02_y20)  (5y03  +2y2ly03  -3y21  +3yi2  ~2y30yi2  ~5U30) 


+  4u1]L(5m12u03  +^30^0  3+9y2iyi2  5y30y21J  (89) 
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3I2(  }  (y03  6  y21y03  +9y21  9y12  +6y30P12_P30) 


■(M02  -3y02P20  -12M02lJll  +2y20Pll  +3y20y02-U20) 


+4P11  (3P12M03  +y30P03  9y21P12  3U30y21) 


(3y02  4yil  6y02y20  +3y20)  * 


(90) 


Similarly,  all  orders  of  moments  can  be  linked  to  form 
invariants.  A  complete  set  of  moment  invariants  with 
respect  to  rotation  and  translation  through  the  fourth 
order  is  listed  in  Appendix  J. 

Comparing  Appendix  J  with  the  moment  invariants  derived 
from  the  algebra  of  invariants  by  Hu,  Eqs  (28)  -  (34),  a 
striking  similarity  can  be  observed.  Eqs  (28)  -  (31)  are 
virtually  identical  with  Eqs  (J-l)  -  (J-4) ,  and  Eq  (32) 
is  very  similar  to  Eq  (J-5)  except  for  coefficients.  It  is 
also  observed  that  there  are  (p+1)  invariants  derived  by 
group  theory  methods,  where  p  is  the  moment  order.  This  is 
exactly  the  same  as  in  Chapter  III.  It  can  be  concluded 
that  the  two  sets  of  moment  invariants,  each  derived  by 
different  methods,  group  theory  and  algebra  of  invariants, 
are  equivalent. 
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V. 


It  is  obvious  that  the  image  signal  over  which  the 
moment  invariants  are  to  be  calculated  depends  on  many 
parameters  of  the  optical  system,  the  object,  and  the 
transmission  channel.  The  effects  of  the  variation  of  the 
parameters  must  be  taken  into  account  in  designing  a 
recognition  system.  The  discussion  to  follow  is  oriented 
toward  visual  data  of  aircraft  in  an  atmospheric  environ¬ 
ment  . 

Invariance  With  Respect  to  Optical  Path  Length 

As  an  object  is  moved  along  the  optical  axis,  it  is 
evident  that  the  image  signal  of  an  optical  system  will 
vary.  A  first  order  effect  is  obviously  a  change  in  size. 

A  second  order  effect  will  be  the  appearance  or  disappearance 
of  small  details  of  the  object.  This  second  order  effect 
diminishes  as  the  optical  path  length  from  sensor  to  object 
increases.  For  aircraft  type  problems,  this  may  be 
negligible . 

The  change  of  size  problem  is  mainly  a  matter  of 
normalization  of  the  image  moments.  A  radius  of  gyration 
is  defined  to  be 


r  JV2  0  +^02 


(91) 
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and  is  directly  proportional  to  the  image  size  or  inversely 
proportional  to  the  distance  of  the  object  along  the 
optical  path  length.  The  product  of  the  radius  of  gyration 
of  the  image  and  the  range  of  the  object  is  a  constant. 
Therefore,  the  general  moment  may  be  normalized  to  be 


u  =  u  / 

pq  pq 


<p  ) (P+q+2)/4 

'  *20  p02; 


(92) 


A  second  choice  of  normalization  follows  the  rule 
derived  earlier,  Eq  (17) ,  under  the  similitude  trans¬ 
formation  . 


(p+q+2)/2, 

1  =  Woo  p+q=2.3,---  (17) 


This  corresponds  to  having  the  average  scene  brightness 
^qq  always  equal  to  unity.  Therefore,  by  dividing  the 
central  moments  by  pQ0 

Mpq  =  Mpq  /#i00  p+q  =  0,1,2  (93) 


the  size  change  effect  is  eliminated.  Of  course,  such 
normalization  is  not  unique.  An  advantage  of  this  method 
is  that  invariance  with  respect  to  scaling  is  obtained. 
That  is,  the  scaled  moment  becomes 


Mpq  =  ffx  P  y  q  ap(x,y)  dxdy 


=  a  p 


pq 


(94) 
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and  after  normalization 


n  -an 
pq  Hpq  /  00 

Ppq  /  M00  (95) 

which  is  the  desired  result. 

Changes  in  illumination 

Another  problem  that  occurs  is  that  under  different 
conditions  of  illumination,  the  image  moments  will  vary. 

For  example,  a  video  camera  takes  a  frame  of  an  aircraft 
at  sunrise  and  at  sunset  at  the  same  range  and  orientation. 
The  shadows  on  the  aircraft  will  be  different,  causing  a 
different  weight  to  be  placed  on  a  particular  area.  Dudani 
eliminated  this  problem  by  using  only  the  boundary  and 
silhouette  of  the  target  (Ref  4:  33-34)  .  However,  it  is 
obvious  that  some  information  is  not  being  used  in  this  case. 

If  instead  of  a  video  detector,  an  IR  (infrared)  sensor 
system  is  used,  the  problem  of  scene  illumination  is 
eliminated,  or  at  least  reduced.  IR  signatures  are 
presently  being  studied  for  identification  purposes. 

Variation  in  illumination  may  also  be  incorporated  into  a 
statistical  classifier. 

Aircraft/Missile  Engine  Plume 

For  the  particular  class  of  targets  which  include 
flying  aircraft/missiles,  there  is  the  unwanted  feature  of 
the  engine  plume. 
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It  will  be  assumed  that  the  entire  aircraft  is  included  in 


the  field  of  view;  otherwise,  it  cannot  easily  be  identified. 
Depending  on  the  range  from  the  optical  system  to  the 
target  and  upon  the  location  of  the  aircraft  with:.)  the 
sensor  field  of  view,  the  engine  plume  may  be  totally, 
partially,  or  not  at  all,  within  the  image.  Also,  the 
plume  might  tend  to  dominate  the  imagery  data.  Therefore, 
the  identification  problem  becomes  much  more  difficult  and 
it  is  desirable  to  "gate  off"  the  engine  plume. 

In  general,  a  distinctive  feature  of  the  plume  is 
required  to  indicate  the  dividing  point  of  the  aircraft  and 
the  plume.  One  such  feature  may  be  that  the  plume  is 
hottest  at  the  exit  of  the  engine.  By  scanning  along  the 
axis  of  the  plume,  it  may  be  possible  to  pick  out  this  point 
and  incorporate  its  coordinates  to  gate  off  the  unwanted 
portion  of  the  image.  Frequency  discrimination  may  also  be 
employed  as  a  distinguishing  feature. 

Target  Background  Clutter 

As  in  the  case  of  the  engine  plume,  the  target  back¬ 
ground  represents  extraneous  and  unwanted  information.  Also, 
in  order  at  least  to  approximate  the  finiteness  condition  of 
the  uniqueness  property  of  moments,  a  background  of  zero 
intensity  is  ideally  desired.  For  the  case  of  aircraft 
data  being  considered,  this  unwanted  information  may  take 
the  form  of  blue  sky  or  clouds. 
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Assuming  an  approximately  constant  intensity  background,  a 
rough  solution  is  to  subtract  from  the  image,  point  by 
point,  a  constant  intensity  depending  on  some  parameters 
of  the  image.  If  the  intensity  at  any  point  becomes 
negative,  it  is  set  to  zero.  Presumably,  the  background 
clutter  would  be  eliminated  or  reduced. 

As  a  first  guess,  the  threshold  constant  was  taken  to 
be  the  difference  between  the  minimum  intensity  and  a 
constant  times  the  difference  between  the  maximum  and 
minimum  intensity  image, 

THRSHD  =  MIN+CONSTANT  •  (MAX-MIN)  .  (33) 

The  above  procedure  was  applied  to  imagery  data  of  a  Hawk 
missile  in  flight  and  the  moment  invariants  were  calculated 
for  the  resulting  image.  Figures  (1)  -  (7)  show  the 
variation  of  the  seven  moment  invariants  derived  earlier, 

Eqs  (28-34)  as  a  function  of  the  threshold  constant.  The 
increment  between  each. plotted  point  is  (MAX-MIN). 

A  jump  in  the  value  of  the  moment  invariants  is  observed  at 
the  second  point  and  a  gradual  variation  over  the  succeeding 
points.  This  indicates  that'  for  a  threshold  of 

THRSHD  =  MIN  +■  ^  (MAX-MIN)  (34) 

the  background  effect  has  been  minimized  and  the  image  of 
the  Hawk  missile  is  the  dominant  factor. 
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Figure  1.  Variation  of  Moment  Invariants  versus  Threshold. 
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The  gradual  variation  over  the  latter  points  of  the  graphs 
indicates  that  the  missile  image  is  being  affected. 

Appendix  C  shows  the  variation  of  the  raw  and  central 
moments  versus  threshold  for  the  same  case.  The  same 
observations  can  be  made  as  above. 
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VI .  Conclusions  and  Recommendations 


In  the  preceding  chapters,  the  general  problem  of  how 
to  identify  an  aircraft  and  its  orientation  was  investigated. 
Specifically,  the  application  of  two-dimensional  moment 
invariants  was  studied  as  a  possible  solution  to  the  image 
pattern  recognition  problem.  The  concept  of  moment  in¬ 
variants,  first  introduced  by  Hu,  was  analyzed  (pp.9-13) 
and  provided  a  clever  method  for  extracting  a  feature  vector 
to  describe  an  image  by  a  number  of  quantities  which  are 
independent  with  respect  to  translation,  similitude,  and 
rotation . 

Another  set  of  moment  invariants  was  derived 
(pp. 27-36)  by  a  completely  different  method  based  on  the 
concepts  of  group  theory  applied  to  the  two-dimensional 
moments  of  an  image  intensity  distribution.  A  complete  set 
of  invariants  under  rotation  was  derived  (pp. 32-36)  from 
which  the  image  can  be  reconstructed.  It  was  shown  that 
Hu's  invariants,  obtained  from  the  algebra  of  invariants, 
can  be  obtained  from  this  set,  and  in  fact,  the  two  sets  are 
totally  equivalent.  Thus,  a  full  circle  was  completed, 
whereby  the  same  set  of  invariants  was  derived  through  two 
complete  techniques,  algebraic  invariants  and  group  theory. 
However,  the  salient  property  of  the  group  theoretical 
approach  is  that  it  provides  a  generalized  technique  to  find 
invariants  under  other  linear  transformations.  The 
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derivation  by  Hu  cannot  be  extended  readily  to  other  trans¬ 
formations.  A  possible  area  of  further  investigation  is  to 
apply  the  group  theory  concepts  to  find  invariants  under 
the  Seidel  optical  aberrations,  coma  and  distortion. 

The  problem  of  background  clutter  in  aircraft  imagery 
data  was  addressed  (pp. 40-49).  A  threshold  level  was  set 
depending  on  simple  image  parameters.  Application  to  actual 
imagery  data  of  a  Hawk  missile  indicated  that  this  may  be 
an  acceptable  starting  point  for  signal  preprocessing. 

Other  image  signal  effects,  including  the  aircraft 
engine  plume  and  illumination  variation,  were  discussed 
(pp. 37-40).  This  area  presents  a  wide  field  for  further 
investigation  into  the  statistical  problems  and  methods  to 
minimize  the  effects  on  pattern  recognition. 

This  thesis  provides  a  starting  point  for  a  follow-up 
study.  Computer  codes  were  written  to  efficiently  calculate 
up  to  twentieth  order  raw  moments  and  then  to  centralize  them 
recursively  (Appendix  K) .  It  is  recommended  that  a  labora¬ 
tory  mockup  of  various  aircraft  and  an  optical  sensor 
system,  video  or  others,  be  set  up  to  provide  imagery  data 
for  all  aspect  angles.  From  this  data,  a  library  of  moment 
invariants  can  be  constructed,  and  a  statistical  analysis 
can  be  performed.  It  is  recommended  that  a  classifier  be 
implemented  to  identify  target  imagery  data  and  the  target 
orientation  in  order  to  determine  to  what  order  of  moment 
invariants  are  required  for  reliable  identification. 
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Appendix  A 


Central  Moments  in  Terms  of  Raw  Moments 

p+q  T 

■„  -  E  E  <-'p+q'J 

i=0  j  =S 

■  jP-J  jq-i+J  Mj.i.j 
where  X  =  M10/M0Q  y  =  M01/M00 

^ i  Binomial  coefficients 

O _ (j-q)+  i-g  rp  _  (P±i.)...--_P-A 

b  2  1  2 

M00 

=  M00  +M01  =  -° 

=  -*  M00  +M01  =  ° 

=  ^  M00-2^  M01  +M02 
=  x  y  M00-  x  MQ1  -  y  M1q  +M11 

=  x  2  Mn(V-2  x  Min  +Mon 


P03  y  M00  +  3  y  M01  3yM02+M03 


■x  y  2  Mnn  +2  xy  Mn1  +  y  2  M.  n  -  x  Mr 


(A- 5) 


-2  y  MX1  +m12 


P21  =  “x  2y  M00  +  x2  M01  +  2  xy  M10  -2  x  M11 


-y  M20  +  M21 


M30  X  M00  +3  X  M10  3  x  M20  +  M30 


^04  =  y4  M00  -4  y3  M01  +  6  y2  M02  ~4  y  M03  +M 


03  ‘04  (A-6) 


M13  =  Xy3  M00  '3  Xy2  M01  -y3  M10  +3  y2  M11  X  M03 


-3  y  M12  +  M13 


y22  =  x2  y2  M00  "2  x2  y  M01  "2  X  y2  M10  +  x2  M02 


+4  xy  MX1  +  y  M20  -2  x  M12  -2  y  M21  +  M22 


X  y  Mnn  -  x  Mnl  -3  x  y  M,  +3  x  M. ,  +3  x  y  M, 


■3  x  m21  -  y  m3Q  +  m31 


U,n  =  *4  Mnn  -4  *3  M10  +6  ^  M20  -4  5  M30  +  M40 


Un,  =  -y5  M00  +  5  y4  M01  -10  y3  mq2  +  10  y2  m03 


"5  y  M04  +  M05  ( A-7 ) 


u  =  _x  y4  mqo  +4  x  yJ  Mq1  +  y’  M1q  -6  x  y“  M  Q2 


-  -3 


-  -2 


-4  y3  M,  ,  +  4  x  y  +  6  y  M, ,  -  x  M 


~4  Y  M13  +  M14 


=  _x2  y3  Mnn  -3  x2  y2  M0,  +  2  x  y3  M10  -3  x2  y  MQ2 


-6  x  y2  Mn  -  y3  M20  +  x  M03  +  6  x  y  M-, 


+3  y2  M21  -2  x  M13  -3  y  M22  +  M23 


=  y2  Mnn  +  2  i3  y  M01  +  3  x2  y2  M10  -S3  Mc 


-6  x2  y  M,  ,  -3  x  y2  M„0  +  3  x2  M12  +  6  x  y  M21 


+  y  M,n  -3  x  M  -2  y  M31  +  M32 
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Appendix  B 


Recursive  Central  Moments 


j  =  M 

pq  pq 


p+q-l  I 

E  E  (p-j)  («-?♦:.) 


l^o  j=S 


•  xP-J  yCl"i+J  -"j,  i-j  (B-l ) 


where  x  =  M10/MQ0  y  =  M01/M00 


e  =  (i-q)  +.  li-q]  T  _  (p+i)  -  |p-i] 

2  2 


a  l 


b /  bi (a-b) 1  Binomial  coefficients 


y00  M00 


(B-2) 


y01  "  Y  M00  +M01  G 


M10  X  y00  +M10  0 


( B  —  3 ) 


y02  Y  U00  2y  y01  +M02 


;i  -  =  “X  y  y00  "  x  lJm  -  y  ym  +M! 


11 


01  J  M10  11 


y 20  U00  2  X  U10  +M  20 


( B-4 ) 
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m03  y  M00  3  Y  P01  3  Y  P02  +M03 


M12  =  y2p00  -2  5  Y  P01  -  y2  M10  -  5  P02  "2y  P11  +M12 


-X  y  y  x  u  -2  x  y  -2  x  M  -y  U  +M 


11  2  20  2 1 


P30  ^  -"^00  -3  "2P10  -3  x  ^20  +M30 


P04  -  -*\o  "4  y3  P01  -6  y2  P02  "4  Y  M03  +M04 


(B-5) 


-  -3 


x  y  U  -3  x  y  W  -y  1*  -3  x  v  ^  -3  v  p 

00  2  01  *  10  *  no  J  ¥  i 


X  m0  3  3  Y  ll12  +M13 


P22  =  ~x2y2  P00  "2  x2y  P01  -2  x  y3  *1 n  -*2  ‘nn  “4  x  y  ^ 


-y  p20  -2  x  w12  -2  y  W21  +M22 


^31  =  ~x3y  ^00  -x3  UQ1  -3  ^io  -3  lln  ~3  x  y  V 


-3  X  P21  -y  P30  +M31 


P40  =  X\o  "4  x3  M10  ~6  x2  M20  “4  X  P30  +M40  (B"6) 


‘‘05  =  ~y\o  -5  Y\l  -10  y3  “02  -10  y2  P03  "5  Y  U04  +M05 


-x  y4  U00  -4  X  ?3  u01  -y4M10  -6  x  y2  yQ2  -4  y3 


-4  x  y  UQ3  -6  y  \>12  -x  PQ4  -4  y  U13  +M14 


M23  =  y00  ~3  ^2y2  M01  “2  x  y3  U10  "3  x2y  U( 


-6  x  y  Pu  -y3y20  -X2  yQ3  -6  x  y  P12  -3  y2P. 


-2  5  y13  -3  y  y22  +M23 


y32  =  -x3y2U00  -2  x3y  yQ1  -3  x2y2  y1Q  ~^UQ2  -6  x2y  yn 


-3  5  y2M20  -3  x2u12  -6  x  y  P21  -y2P30  -3  x  U22 


-2  y  U31  +M32 


P41  =  "x4y  y00  -x4y01  "4  x3y  yiO  "4  x\l  ~6  x2y  y20 


"6  *  ^21  "4  X  y  P30  "4  X  y31  "y  y40  +M41 


y50  =  -x5y00  "5  x4yi0  ~10  x3  y20  -10  x2  y30  ~5x  y 40  fM50 


(B-7) 


Appendix  C 


Additional  Data  of  Threshold  Analysis 

This  appendix  contains  additional  data  pertaining  to 
the  target  background  thresholding  problem  in  Chapter  IV. 

Table  C-l  lists  numerical  values  of  the  raw  moments  through 
the  third  order  as  the  threshold  was  varied.  Figures  C-l 
through  C-10  show  the  same  data  in  graphical  form.  Table 
C-2  and  Figures  C-ll  through  C-20  illustrate  the  same  process, 
but  for  the  central  moments. 
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Variation  of  Raw  Moment  M  -  versus  Threshold 
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Figure  C-6.  Variation  of  Raw  Moment  M_n  versus  Threshold 
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Figure  C-9 .  Variation  of  Raw  Moment  M01  versus  Threshold. 


"0 


38  1.48  1.58  1.68  1.78  l.BB  1.98  2.08 

THRESHOLD  *10"“ 


of  Central  Moment  versus 


to 

p 

w 

p 

0 

> 


o 

3. 


-p 

c 

0 

£ 

o 

2 


0 

P 

-P 

c 

0 

u 

4-1 

0 


T3 

' — 1 
0 
-C 

w 

0 

p 

Jp 

E-i 


u 


0 

p 

p 

O' 


; 

■! 

i 


CM 

PD 

OD 

o 

r* 

a 

« 

CO 

m 

o 

a 

o 

LO 

‘ — F 

a 

■* 

a 

t" 

r — 1 

o 

UJ 

o 

CD 

LQ 

a 

a 

_J 

• 

• 

• 

CD 

CD 

CD 

*■ — < 

o 

a 

a 

■ — i 

a 

CD 

cn 

a 

CD 

CO 

11 

ii 

ii 

II 

CD 

CD 

i — i 

a 

CD 

zr 

' — • 

00 

a 

CD 

CrO 

a 

< — • 

a 

a 

xz 

a 

cr 

to 

y— 

■ 

• 

uc 

CX 

Oil 

CD 

u. 

□ 

CD 

cr 

cd 

x_, 

X 

X 

X 

O' 

UJ 

ii 

II 

_J 

CJ 

H- 

x 

CD 

z 

X 

z 

CD 

> — » 

X 

X 

X 

1 — 1 

a_ 

>- 

at 

X 

X 

•3 


Figure  C-13.  Variation  of  Central  Moment  versus 

Threshold . 
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Appendix  D 


Orthogonality  Relations  of  Group  Representations 

Schur's  Lemmas 

I.  If  D  and  D'  are  two  irreducible  representations  of 
a  Group  G,  having  different  dimensions,  then  if  the 
matrix  A  satisfies  D(R)  A  =  A  D' (R)  for  all  R  in  G, 
it  follows  that  A  is  the  zero  matrix. 

II.  If  the  matrices  D (R)  are  an  irreducible  represent¬ 
ation  of  a  group  G,  and  if  A  D(R)  =  D(R)A  for  all 
R  in  G,  then  the  matrix  A  is  a  multiple  of  the 
identity  matrix. 

Given  an  irreducible  representation  of  degree  n  for  the 
group  G  of  order  g,  matrix  A  is  constructed  to  satisfy  the 
conditions  of  Lemma  II, 

A  =  ]C  D(S)  X  D(S-1)  (D-l) 

S 

where  X  is  an  arbitrary  matrix  and  the  summation  is  taken  over 
the  entire  group.  Then 


(D-2) 


T 


D(R)  A  =  D (R)  D (S)  X  D(S  1) 

S 


=  D(R)  D(S)  X  D(s_1)  D (R~ 1 )  D (R) 

(D-3) 

s 

D(RS)  X  D ( | RS | -1) • D (R) 

(D-4) 

S 

=  A  D{R) . 

(D-5) 

According  to  the  lemma,  A  is  a  multiple  of  the  unit  matrix, 
A  =  \xl,  X  is  chosen  to  have  all  its  elements  zero  except 
X-  =1.  The  constant  is  then  denoted  by  X,  and 

I  m  •*  i  m 


5DilIS)  Vi13"1)  -  Xlm  aij  •  <D-6> 

If  D  is  unitary. 


EDil(S>  Djm'(SI  =  hmSij  •  <D-7> 


To  evaluate  ,  set  i=j  and  sum  over  i, 

E  E  D11(S)  “mi'5'1*  =  ”Tm 


82 


*E  “ml*33'1* 

s 

'E  Dml<E» 

s 

-r  5»i 

s 


lm  t)  lm 


( D—  8 ) 


Therefore, 


E  Dii  's> 

s 

and  for  D  unitary, 

E  Dii(s! 

s 

Likewise,  given  any  two  nonequivalent  representations, 
and  ,  of  a  group  G,  matrix  A  is  constructed  to 

satisfy  Lemma  I, 


D  (S~  )  =3-6  6 

mj  ’  n  lm  ij 


(D-9) 


D  ,  *  (S)  =  a  6  6 

jmv  1  lm  ij 


(D-10) 


A  =  V  D(2) (S)  X  D(1) (S'1), 


( D-l 1 ) 


where  X  is  an  arbitrary  matrix  and  the  summation  is  over  G. 
Then 

D ( 2 ) (R)  A  =  ^  D(2) (S)  X  D(1) (S-1)  (D-12) 

S 

=  53  D(2) (R)  D(2) (S)  X  D  (1) (s_1) 

S 

D(1) (R_1 )  D(1) (R)  ( D— 1 3 ) 

=  53  P(2) (RS)  X  D(1) (| RS |_1)  D(1) (R)  (D-14) 

S 

=  A  D(1) (R) .  (D-l 5) 

According  to  Lemma  I,  A  is  the  zero  matrix.  Thus, 

53  P(2) (S)  X  D(1) (S-1 )  =  0.  (D-16) 

S 

If  X  is  chosen  as  before, 

•  £  ^  (S)  (S_1)  =  0  (D-17) 

S 

for  all  i,  j,  1,  m.  If  both'  representations  are  unitary, 

53  D- 2)  (s)  * (S)  =  0.  (D-18) 

S 
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Taken  together,  Eqs  (D-9)  and  (D-17)  imply  that  for 


all  nonequivalent  irreducible  representations  of  G, 


E 


6 

V  v 


6  . 
ij 


(D-19 ) 


For  the  unitary  case, 


E 


d<;>  (r> 


D  f  ^  *  ( R  1) 
jm 


6  6 
V-v  ij 


6lm-  (D~20) 
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Appendix  E 


Derivation  of  the  Projection  Operator 


Multiply  Eq  (65),  Or  Y 
(u )  * 

by  D^m  (R)  and  sum  over  the 

z  vi*  -  z 

R  i 

Due  to  orthogonality. 


entire  group, 

'i'iV)  LDlm*(R)  <R>  •  (E-l) 

R 


E  D 

R 


(y)  * 
lm 


(R) 


Vf”  - 


-n!  S  ' 


(v). 


Ij 


mi 


yv 


.  a  *‘v) 
\ 


i.i 


yv . 


(E-2) 


(E-3) 


Then  for  m=l  and  y  =v. 


E 


,(v) 

J11 


(R)  0„  Y 


(v) 


and  for  1  -  i. 


£ 


D^J*(R) 


(v) 


¥  (v) 
i 


(E-4) 


(E-5) 


This  is  a  necessary  condition  on  ^ V)  ,  and  in  fact,  it  is 
also  a  sufficient  condition  such  that  Eq  (65)  is  satisfied. 
This  is  proved  by  substituting  Eq  (E-3)  into  Eq  (65) : 


y,(v}  (v 

j  ji 


,v>  «>  - 


Djk)*<R)  Vk"’ 


nil- 


jr*  <» 


o  V 

uRrK 


(S)  ( E— 6 ) 


(E-7) 


but  is  Hermitian 


-  ^  I  [2  <’*<*’]  V 


(V) 

K 


D(AB)  '  D (A)  D (B) 


v 

g 


2  K,*<r'1r' 

R  1 


O  ij»  (v ) 

R  K 


v  v- 

•  1  °s  I  °< 


-1 


Dik)*(S~lR) 


O  ¥(V) 
°R  K 


(E-8) 


(E-9) 


(E-10) 


and  by  Eq  (43) 


=  T  »sl  VJSV> 


(E-ll) 


but  this  is  Eq  (E-3) 


-  °s  *1* 


(E-12) 


■j 

and  the  desired  result  is  obtained.  i 

\ 
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From  Eq  (E-3)  for  m  -  1 


D*JJ*  (R)  OrV.[V)  =na  )  6li  6yv 


Define  a  projection  operator  to  be 


(E-13) 


,(V)  _  JL 

i  <3 


L  »£>*«>  o. 


(E-14) 


such  that 


.! 


pi  i  yv  ®ij* 


(E-15) 


If  the  projection  operator  is  applied  to  Eq  (46), 


,(y)w  = 


pjy) 


(V) 


V  i=l 

n. 


•lit-  *J 


(y) 


V  i=l 


6yv  6ij* 


(E-16) 


(E-17) 
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y’o5 

C5+5C3+10C 

-5(S5+3S3+2S 

~10  (C5+C3-  2C) 

y’l4 

S5+3S3+2S 

5C5+9C3+2C 

-2(5S5+3S3-2S) 

y  ’  23 

1 

-(C5+C3-2C) 

5S5+3S3-2S 

2(5C5+C3+2C) 

y*32 

1 

=15 

-(S5-S3-2S) 

-(5C5-3C3-2C) 

2(5S5-S3+2S) 

y '  41 

C5-3C3-2C 

-(5S5-9S3+2S) 

-2(5C5-3C3-2C) 

M,50 

S5-5S3+10S 

5(C5-3C3+2C) 

-10(S5-S3-2S) 

— 

—  — 

10(S5-S3-2S)  5(C5-3C3+2C)  -(S5+5S3+10S 

V05 

-2(5C5-3C3-2C)  5S5+9S3+2S  c5“3C3+2C 

y14 

-2(5S5-S3+2S)  -(5C5-3C3-2C)  S5"S3“2S 

y23 

2(5C5+C3+2C)  -  (5S5+3S3“2S)  -  (C5+C3-2C) 

y32 

2(5S5+3S3-2S)  5C5+9C3+2C  -(S5+3S3+2S) 

y41 

-10(C5+C3-2C)  5(S5+3S3+2S)  C5+5C3+10C 

y50 

(F-8) 
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6<S6+4S4+5S2) 


y,06 

Cg+6C4+15C2+lG 

-6(Sg-f4S4+5S2) 

w'l5 

V4S4+5S2 

2(3Cg+8C4+5C2) 

^ '  24 

- (Cg+2C4-C2~2) 

2(3Sg+4S4-S2) 

^*33 

1 

-(S6-3S2) 

-6(Cg-C2) 

^ '  42 

"31 

C6-2C4‘C2+2 

-2(3Sg-4S4-S2) 

w '  51 

5Ag-4S4+5S2 

2(3Cg-8C4-5C2) 

y,60 

-(Cg-6C4+15C2-10) 

6(Sg-4S4+5S2) 

-15(C6+2C4-C2-2)  20(S6-3S2) 

-5 (3Sg+4S4~S2)  -20(Cg-C2) 

15Cg+10C4+C2+6  -4(5Sg+S2) 

3(5Sg+S2)  4  (SC ^+^2) 

-(15Cg-10C4+C2-6)  4(5Sg+S2) 

-5(3Sg-4S4-S2) 1  -20{C7-C2) 

15(Cg-2C4-C2+2)  -20(Sg-3S2) 


15(Cg-2C4-C2+2) 

5(3Sg-4S4-S2) 

-(15Cg-10C4+C2-6) 

-3(5Sg+S2) 
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5(3Sg+4S4-S2) 
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“*  “ 
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U06 
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V16 
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Appendix  G 

Useful  Trigonometric  Identities 

C  =  COSnS 
n 

S  =  SINn  6 
n 

.  i 

SASB  =  2  (CA-B  "  CA+b) 

CACB  =  2  (CA+B  +  CA-b) 

SACB  =  2  (SA+B  +  SA-B ) 

s2  .  |  k  + 1) 

i 

CS  =  2  s2 

C2  =  2  (C2  +  3) 

S3  =  |  (-83  *  38) 

CS2  =  j  (-c3  +  C) 

c2s  =  f  (s3  +s) 


(G-l) 


(G— 2 ) 


(G-3) 


-  __ 
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*6  ■  32  (-C6  +  6C4  -  15C2  +  *§) 


=  37  ( 


'S6  -  4S4  4  5S2) 


C  S  =  32  (C6  -2C4  -C2+2) 

f 

C3s3  =  32  He  +  3S2) 


,4_2  _  1 


=  3f  (- 


C6  =2C4  +  C2  +2) 


=  32  ( 

-sU' 


S6  +  4S4  +  5S2) 


C6  4  6C„  4  15C2  4  if) 


(G-7) 
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Projected  Moment  Vectors 
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=  —  (y  +2y  +y  )  =  0 
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8  (y40-6y22+y04) 


2  (y31“y13) 


(H-10) 


(2)  _ 


2  (y31+yi3> 


"4  (y40_y04) 


(H-ll) 


_ 


Y<1) 

*05 

= 

8  (U 

v(l) 

X05 

= 

1  <M 

Y  ( 3) 

5 

X05 

"16 

v(3) 

5 

Y05 

16 

y(5) 

1 

X05 

16 

v(5) 

1 

Y05 

"16 

Yd) 

1 

X14 

8 

Y(l) 

1 

Y14 

8 

Y  (3) 

3 

X14 

"16 

Y  ( 3) 

3 

Y14 

-16 

Y(°) 

20 

X06 

32 

Y(0) 

*06 

= 

0 

41  ^  h23-  h05 


J41'iUH23TH05; 


'l50-AW  *32^  **14J 


8  <y41+2y23+lW 


50”  32  14' 


-16  (3VJ41+2y23-yi5) 


(H-12) 


(H-13) 


(H-14) 


(H-15) 


(H-16) 


(H-17) 
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y  (2) 
a06 

= 

15 

32 

(y60+y42_y24“y06) 

y2) 

*06 

= 

30 

-32 

<y51+2y33+yi5> 

(H-18) 

y  {  4  ) 
X06 

= 

6 

32 

<y60-5y42-5y24+y06> 

v  (4) 
*06 

= 

24 

32 

<y5l-y!5> 

(H-19) 

y(6) 

X06 

= 

1 

32 

<y60-15y42+15y24-U06> 

v(6) 

*06 

= 

2 

-32 

(3y5i-10y33+3yi5) 

(H-20) 

y  (2) 

±5 

= 

10 

32 

(y51+2y33+yi5) 

Y  (2) 
*15 

= 

5 

-32 

{y60+y42'y24~y06) 

(H-21) 

y(4) 

X15 

= 

16 

-32 

1  51  15* 

Y  (4) 
x15 

= 

4 

32 

(y60-5y42-5y24+y06) 

(H-22) 
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Appendix  I 


Moment  Invariants  From  Projected  Moment  Vectors 


T(°) 

00x00 


4y00 


(1-1) 


T(0)  _ 
00  x02 


2y00  ^20+p02^ 


OO1^  2^00  ^40+2y22+*J04* 


l(°)  = 

02x02 


j(0)  = 

02  J'04 


^20+vj02^ 


4  ^20  +  ^02^  (y40+2y22+y04^ 


j (0)  _  —  (U  +2W  +u  ) 2 

04104  16  lM40  ^y22  y04> 


T  (2) 

01i01 


jd) 

01x03 


I(1)  = 
01x12 


id) 

0x05 


id) 

01x14 


y01  +  y10 


4  U01(y21+P03)  +  4  yi0(y30+yi2) 


4  y01(y30+yi2)  “  4  yi0(y21+y03) 


8  U01 (y41+2P23+y05)  +8  yi0 (y 50+2y 32+U14) 


8  y01(y50+2U32+yi4)  "8  U10  41+2y 23+y05} 


(1-2) 


(1-3) 


(1-4) 


(1-5) 


(1-6) 


(1-7) 


(1-8) 


(1-9) 


(1-10) 


(1-11) 


t  ^  ^  =  —  (y  +y  )^  +  —  (W  +  y  )  ^ 
03X03  16  '21  03'  16  1  30  12; 


03I05>  32  (y21+M03)  ( yi4+2  M23+lW 


+  32  ‘W  (y50+2y32+yi4) 


03I14)  32  (y21+y03}  (  V50+2  y32+ yi4J 


-32  (U30+yi2>  <U4l+2»!23+y05> 


OS1^1  64  (y41+2  ^3+y05)2  +  64  ( P50+2y32+yi4) 


T  (2) 
02x02 


i  ( y  _y  )  ^  -f  y  2 
4  1 M20  02;  11 


I(2) 

02x04 


4  (y20-y02>  <y40-y04J  +yil  ^I^IS* 


02113)  4  (y20"y02)  (y31+yi3)  +  4  *11  ( *40“ ^4* 


I^2^  =  —  (y  _y  +  (y  +  y 

i1"'  *  '  *Ar\  ^r\A '  T  '  3113' 


0404  4  '  40  04 


=  —  (3  y  _y  +  i  /y  y  \2 

03x03  16  21  03'  16  1  30  J  12* 


OS1^!’  =64  <3“21-U03>  (3>,41+21,23-,,05» 


+64  (y30"3yi2)  (  y50_2P32-3yi4) 


(1-12) 

(1-13) 

(1-14) 

(1-15) 

(1-16) 

(1-17) 

(1-18) 

(1-19) 

(1-20) 

(1-21) 
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03I14)  '  64  (3u21“y03)  * y50-2 U32~3 U145 


-64  (P30-3yi2)  (3U41+2y23-y05) 


Ob1^  "2ft  (3M41+2M23  M05) 


•  +25f  (y50-2y32-3P14>2 

04I04)  =  64  (  y40-6  P22+ ^04^  2  +  4  * *31" *13* 2 


1^^  =  —  _io  y  +  v* 

05i05  256  lb  41  iU  23  05' 


+256  (U50"10M32+5M14)2 


(1-22) 


(1-23) 


(1-24) 


(1-25) 
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Appendix  J 


A  Complete  Set  of  Moment  Invariants 
Through  Fourth  Order  Moments 


(0) 


I(0)  = 
212 


(y20  ‘t;y02) 


I(2)  = 
212 


(y20  -y02)2  +4yll 


I  ID  * 
3X3 


<v21  +1,03|2  +  (1,30+1,12)2 


I<3) 
31 3 


(3u21  _lJo3^  +  *3y12~y20* 


I(2)  = 
312 


(y02~y20)  (5U03  +  2U2ly03  "3y21  +3yl2 


_2y30y!2  ~~*y30^  +  4yll  {5U12y03  +y30y03 


+9U2lyi2  ”5y30U21* 


I(6)  = 

3X2 


(W03  "6y21y03  +9y21  "9y12  +6y30y12  "V30) 


(J-l) 


(J-2) 


(J-3) 


(J-4) 


(J-5) 


(y02  "3y02y20  “12y02yll  +2y20yll  +  3y20  y02  "y20) 


+4yii(3yi2yo3  +P30y03  '9y21y12  "3y30y21) 
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<3^02  -4yll  -6y02y2Q  +3y20} 


(J-6) 


H 

o 

= 

<>■40  *2V22  +l,04>2 

(J-7) 

•u 

H 

— 

to 

= 

<U40  -,,04>2  +4(l,3i  +1,13>2 

(J-8) 

i(4) 

4i4 

= 

(“40  “22  +>,04>2  +4  (>,31  -“l3>2 

(J-9) 

I{2) 

4X2 

O^'V  <m40  'V  +  4Mn  ,P3i 

+“n> 

(J-10) 

I(4) 

4X2 

* 

(“31  *“13>  <“02  -2l,02u20  -iVll  +U20> 

+3  “13  (  “04  -V  (P20  ‘V 

(J-ll) 
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Program  Name :  CENTER 

Purpose:  To  calculate  recursively  and  to  normalize  two- 

dimensional  central  moments  from  two-dimensional 
raw  moments. 

Method:  The  pq-th  central  moment  (p  )  is  calculated 

pq 

recursively  from  the  pq-th  raw  moment  (M^)  and 
the  lower  order  central  moments  using  the  formula. 


5-  i  (,’, )(-*«)  ■ 

'  r  '  f 


p-j  q-i+j 

y  V 


00  i=0  j=S 

where 


j/i-J 


S  =  -|  [(i-q)  +  |  i  -q  |  ] 


T 


x 


y 


a 

b 


=  |  [(p+i 


M10/M00 


M01/M00 


a  l 


bl (a-b) 1 


binomial  coefficient 


Calling  Procedure:  CALL  (M,N) 

Arguments:  N-l  =  highest  order  of  moments  to  be  computed. 

M  =  N  x  N  matrix  containing  the  raw  moments 
to  be  centralized  and  normalized 
M  (p+1,  q+1)  =  Mpq 
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For  output,  the  raw  moments  are  replaced  by 
the  central  moments 
M  (p+1,  q+1)  =  Mpq 
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Program  Name:  MOMENT 


Purpose: 


Method: 


To  calculate  up  to  twentieth  order  two-dimensional 
raw  moments  over  an  image  intensity  distribution. 
The  first  Newton-Cotes  equation  was  used. 

Jr  x2 

xl  y(x)  dx  =  . 5h  (yx  +  y2)  ~12  h3  Y 

.  i 

The  two-dimensional  moment  M  is  defined  in 

pq 

Cartesian  coordinates  as 

M  =  /  /  xp  yq  f  (x,  y)  dxdy 

pq  J—  OD  j  ■—  CD 


and 


Mpq  =  [yqf(x'Y)dy]  dx 


=  Jx9  V  (x)  dy 


where 


Vq(X) 


dy 


or 


I 


(yl£li  +  y 


q  f  . ) 
N  Ni' 
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where  is  the  ji-th  element  cf  an  N  x  N 

image  intensity  distribution  array,  y^  is  the 
corresponding  vertical  coordinate,  and  h  is  the 
width  of  each  image  element. 


0 


Calling  Procedure:  CALL  MOMENT  (R,  N,  M,  L) 

Arguments:  N  =  number  of  image  elements  per  row/column 

of  an  image  intensity  distribution  array. 

R  =  N  x  N  square  matrix  containing  the  values 
of  the  image  intensity  distribution. 

L  -  1  =  highest  order  of  moments  to  be  computed 
M  =  output  matrix  containing  the  computed 
moments 

M  =  M (p+1 <  q+1) 

P<3 

Subroutines  Used:  VPROD 

Note:  The  image  dimension  is  normalized  to  unity. 
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Program  Name :  INVRNT 

Purpose:  To  calculate  moment  invariants  involving  the 
second  and  third  order  central  moments. 

Method:  Direct  algebraic  computation  based  on  the  moment 

invariants  from  Ref  1. 

Calling  Procedure:  CALL  INVRNT (MI , M, Q) 

Arguments:  Q-l  =  highest  order  of  central  moments  to  be 

used. 

M  =  Q  x  Q  input  matrix  of  moments  to  be  used 
to  calculate  the  moment  invariants  where 
M(p+1 ,  q+1)  =  Upg 

MI  =  one-dimensional  output  array  containing 
the  computed  moment  invariants 
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Program  Name:  MI CALC 

Purpose;  Serves  as  a  monitor  program  to  call  appropriate 
subprograms  to  input  data,  compute  raw  moments, 
calculate  central  moments  and  moment  invariants, 
and  then  to  display  them. 

Arguments:  N  =  number  of  image  data  points  per  line  of 

a  square  image 

Q-l  =  highest  calculated  moment  order 

S  =  number  of  moment  invariants  calculated 
Image  Data:  The  program  inputs  imagery  data  from  a  tape 
format.  An  unformatted  READ  inputs  a  vertical 
image  line,  256  pixels  per  line  and  256  lines. 


Program  Name:  VPROD 

Purpose:  To  compute  the  inner  product  of  two  vectors. 


* 


Method:  Double  precision  multiplication  and  addition  are 

used;  a  single  precision  result  is  returned. 
However,  the  double-precision  result  is  available. 
Calling  Procedure: 

CALL  VPROD  (A, NA, B , NB, N, V) 
or 

DOUBLE  PRECISION  Z,  VPROD 
Z  =  VPROD  (A, NA, B, NB , N, Z) 

A  -  Linear  string  of  elements  of  the  first  vector 
NA  -  Interval  between  elements  of  A  used  in  the  inner 
product 

B  -  Linear  string  of  elements  of  the  second  vector 
NB  -  Interval  between  elements  of  B  used  in  the  inner 
product 

N  -  Number  of  pairs  of  elements  multiplied  together 
V  -  Storage  location  for  single  precision  result 
Z  -  Storage  location  for  double  precision  result 
Error  Indicators:  None 

Subroutines  Used:  None 


Program  Name :  PPLOT 

Purpose:  To  generate  a  polar  graph  on  the  Calcomp  plotter 
of  moment  invariants 
Calling  Procedure:  Call  (MI,R) 

Arguments:  R  =  the  number  of  moment  invariants  to  be 

plotted 

MI  ,=  array  of  R  moment  invariants 
Output  generated  for  on-line  Calcomp  plotter 
Subroutines  Used:  basic  and  auxiliary  Calcomp  routines 
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Program  Name:  BPLOT 

Purpose:  To  generate  a  bar  graph  on  the  Calcomp  plotter 
of  two-dimensional  moments  (up  to  20th  order) 
Calling  Procedure:  CALL  BPLOT (M,N) 

Arguments:  N-l  =  highest  order  of  moments  to  be  plotted. 

M  =  N  x  N  matrix  containing  the  moments 
to  be  plotted. 

M(p+1, q+1)  =  M  ;  pq-th  moment 
Ph 

Output  is  generated  for  on-line  Calcomp  plotter. 
Subroutines  Used:  basic  and  auxiliary  Calcomp  routines 


Program  Name:  INVRN1 

Purpose:  To  calculate  moment  invariants 

Method:  The  moment  invariants  are  generated  via  the  group 

theory  procedure  developed  in  Chapter  IV.  The 
computed  invariants  up  to  the  fifth  order  are 
listed  in  Appendix  I. 

Calling  Procedure:  CALL  INVRNl (MI, M, Q) 

Arguments:  Q-l  =  highest  order  of  central  moments  (y  ) 

P<3 

to  be  used  in  computation.  1  -  Q  -  21. 

M  =  Q  x  Q  input  matrix  of  moments  to  be  used 
to  calculate  the  moment  invariants 
where 

M (p+1 ,  q+1)  =  u 

Pm. 

MI  =  one-dimensional  output  array  containing 
the  computed  moment  invariants. 
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Program  Name :  PARRAY 

Purpose:  To  serve  as  a  monitor  program  to  generate  plots 

of  moments  as  a  function  of  threshold. 

Calling  Procedure:  CALL  PARRAY  (M,  THRSH,  A,  B,  C,  D,  E,  F) 
Arguments:  M  =  20  x  4  x  4  input  matrix  containing 

the  moments  to  be  plotted 
THRSH  =  1  x  22  array  of  threshold  values 

A,  B , C , D  =  image  parameters;  roll,  pitch,  yaw, 
range 

E  =  maximum  image  intensity 

'  F  =  minimum  image  intensity 

Subroutines  Used:  LPLOT 
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Program  Name:  MIARAY 

Purpose:  To  serve  as  a  monitor  program  to  generate  plots 

of  moment  invariants  as  a  function  of  threshold. 
Calling  Procedure:  CALL  MIARAY  (Mil , THRSH, A, B, C, D, E, F, ) 
Arguments:  Mil  =  20  x  7  input  matrix  of  the  moment 

invariants  to  be  plotted. 

TH^SH  =  1  x  22  array  of  threshold  values 

A,  B ,  C,  D,  =  image  parameters,  roll,  pitch,  yaw, 
range 

E  =  maximum  image  intensity 

F  =  minimum  image  intensity 

Subroutines  used:  LPLOT 
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Program 

Purpose 

Method: 


.  »■  *ip 


Name :  IMAGE 

To  generate  a  character  printed  image  from 
imagery  data. 

The  imagery  data  is  read  into  an  array,  and  the 
minimum  and  maximum  intensities  are  found.  This 
range  of  image  intensities  is  divided  into  10 
levels.  Each  level  is  assigned  a  character: 

_ ,  1,  2,  3, ‘*‘9,  from  minimum  to  maximum, 

respectively.  The  image  is  gated  to  narrow  the 
viewing  area.  The  gated  array  is  then  character 
printed  on  the  line  printer. 


Subroutines  used:  None 
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Program  Name:  LPLOT 

Purpose:  To  generate  a  line  plot  of  moments  or  moment 
invariants  as  a  function  of  threshold. 

Calling  Procedure:  CALL  LPLOT  (YARRAY, XARRAY, LABEL, 

R ,  P ,  Y ,  RG ,  MX ,  MN ) 

Arguments:  YARRAY  =  one-dimensional  array  of  abcissa  values 
XARRAY  =  one-dimensional  array  of  threshold 
valves 

LABEL  =  label  of  abcissa 

R  =  target  roll 

P  =  target  pitch 

Y  =  target  yaw 

RG  =  target  range 

MX  =  maximum  image  intensity 

MN  =  minimum  image  intensity 
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Program  Name :  THRSHD 

Purpose:  To  determine  a  threshold  level  to  suppress  the 
background  from  imagery  data 
Method:  The  second  and  third  order  raw  and  central 

moments  and  the  corresponding  moment  invariants 
are  computed  as  a  function  of  threshold  level 
where 

THRSHD  =  MIN  -  constant  *  (MAX-MIN) 

MAX  =  maximum  image  intensity 

MIN  =  minimum  image  intensity 

Subprograms  Used:  CENTER 

INVRNT 

PARRAY 

MIARAY 
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